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PART I: CONSULTANT IDENTIFICATION 



Between June, 1967 and August, 1967, CERLI staff members 
conducted a series of evaluative activities designed to critically 
examine the progress of the Evaluator Development Program to date 
and to obtain suggestions for its modification and further develop- 
ment. A list of prospective consultants professionally qualified 
to serve in this phase of the evaluation activity was identified. 

Initial contact with these persons was established through telephone 
conversations structured to ascertain the interest and ability to pros- 
pective consultants and to discuss briefly the program ana the CERLI 
staff expectations of the role of the consultants. (See Appendix AX 
Upon receiving an agreement to serve, CERLI 1 s Indianapolis office 
forwarded the consultants a letter of instructions and a consultant 
form. (See Appendices B and C) . Follow-up interviews and telephone 
contacts were arranged to discuss, clarify, or supplement the 
evaluative remarks rendered by the consultants. 
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Listed below are the names and positions of those persons who 
served as program consultants, and from which responses were 
received on or before August 1, 1967. Only the responses of these 
persons are included in this document. However, it should be noted 
that the suggestions of two consultants who participated in structured 
interviews, but had not returned consultant forms by August 1, 1967, 
are included in this report. 



Dr. Haron Battle 

Assistant Superintendent of Instruction 
Gary Public School System 
Gary, Indiana 

Dr. John Best 
Professor of Education 
Butler University 
Indianapolis, Indiana 

Dr. Glenn C. Boerrigter 
Coordinator 

TJ, S. Office of Education 
Washington, D.C. 20024 

Dr. Gordon Cawelti 
Executive Secretary 
Commission on Secondary Schools 
North Central Association 
Chicago, Illinois 60615 

Dr. David Clark 
School of Education 
Indiana University 
Bloomington, Indiana 

Dr. Claude W. Fawcett 
Department of Education 
University of California 
Los Angeles, California 90024 
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Dr. William K. Flottmann 

Eastern Illinois Development and Service Unit 
406 W. Johnson 
Charleston, Illinois 

Dr. Gerald Gleason 
Director of Research 
School of Education 
University of Wisconsin 
Milwaukee, Wisconsin 

*Dr. lames Griggs 
Dean, School of Education 
Western Michigan University 
Kalamazoo, Michigan 

Dr. John J. Horvatt 
Executive Officer 

The National Institute for the Study 
of Educational Change 
825 East 8th Street 
Bloomington, Indiana 47401 

Dr. Norinan Kurland 

Director, Center on Innovation in Education 
New York State Education Department 
Albany, New York 12224 

Dr. C . M . Lindvall 
Associate Director 

Learning Research and Development Center 
University of Pittsburgh 
Pittsburgh, Pennsylvania 

*Dr. Ken Lund 
Vice President 

Scott Foresman and Company 
Chicago, Illinois 

Dr. Ralph Lundgren 
State Department of Education 
Title IV, ESEA 
Springfield, Illinois 



^Indicates those persons who had not returned consultant forms 
by August 1, 1967 . 
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Dr. Richard I. Miller 

Director# Program on Educational Change 

University of Kentucky 

Lexington, Kentucky 40506 

Dr. Roland J. Pellegrin 
Director, Institute for Community Studies 
University of Oregon 
Eugene, Oregon 

Dr. Daniel L. Stufflebeam 
Director, Evaluation Center 
Ohio State University 
Columbus# Ohio 43210 



PART lit CONSULTANT RESPONSES 

General Reactions, Typically the consultant responses to the program 
were laudatory although reactions ranged from mildly negative to extremely 
positive. Consultants reported that the program represented a compre- 
hensive, challenging# difficult# and essential piece of work focused upon 
a vita' area. The EvaluaLor Development Program was viewed as being 
extremely significant and represented an innovative approach of major 
magnitude. One respondent remarked that if any of the treatments do the 
task as defined in footnote eleven, they will be highly useful.* One 
respondent expressed the opinion that most of the preliminary work had 
been done by others long before this.^ Observers who had followed the 
progress of the program since its inception in February, 1967# reported 
that excellent progress had been achieved. 



^"A task is defined as developed when it has been explicated, skills and 
competencies identified and treatments developed and tested to cause 
effective skills development. A developed task is capable of replication.” 
(Footnote 11, p. 10, Working Paper #10). 

?The staff pursued this lead but vsasable to locate only bits and pieces of 
writings# mostly unrelated and fugitive-like in nature: typically this 
material was "it ought to be done” in nature rather than substantive. 
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The major recommendations and responses of the consultants are 
reported in two sections: Section A - Consultant Suggestions, and 
Section B - A Tabulation of Responses to Task It*ms on the Consultant 
Form, 

Section A: Consultant Suggestions. The main suggestions for the 
modification of the Evaluator Development Program in response to 
the instructions in the Consultant Form which requested consultants 
to render evaluative remarks, suggestions, and recommendations 
relating to the. Evaluator Development Program are classified into 
the following categoiits: 

1, Conceptual Framework » Additional consideration needs to 
be given to the theoretical or taxonomic structure which 
interconnects and relates the evaluative tasks. An 
extensively developed conceptual base from which to judge 
the relationship of tasks, theii significance to the process 
of evaluation, and priorities for development would 
strengthen the program* 

2, The Tasks, A majority of the consultants pointed out the 
apparent duplication, repetition, and overlap among the 
described tasks. A comi..on suggestion was the need to 
organize the tasks into a limited number of major task 
categories consistent with a conceptual framework discussed 
above. An inconsistency in the degree of specificity of the 
tasks was pointed out as well as the need to re-state some 
tasks to achieve compatibility between the task statements 
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and the acts to be performed in their implementation. 

Listed below are some of the tasks suggested as missing 
from the original task list: 

a. To develop general criteria for application in 
measuring the effectiveness and efficiency of 
existing innovative practices and products, i.e., 
minimum standards and outcomes which indicate 
successful utilization of practices and products. 

b. To evaluate program plans in terms of complete- 
ness, specificity and congruence . 

c. To evaluate changes in stcff behavior. 

d. To evaluate criteria and procedures for personnel 
selection. 

e. To forecast continuously decision-making pro- 
cesses and associated Information requirements. 

f. To evaluate the on-going evaluation program. 

g. To define the major audiences for evaluative 
information. 

3. Field Work. It was suggested that the program be modi f ied 
to work more closely with practitioners in the field who are 
performing evaluative responsibilities. One consultant 
suggested that persons currently implementing evaluator 
functions be identified for the purpose of locating an 
operational model around which an alternative program 
approach might be built. 
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4. Position Development. The suggestion was made that more 
attention be given to the relationsnip between new positions 
and existing positions within present organizational structures. 
Additionally, it was suggested that more concern be given to 
the organizational problems and strategies necessary for the 
implementation of more effective evaluation positions and 
procedures. More consideration should be given to the poten- 
tial roles of organization such as state departments of education 
and intermediate educational units and associations in 
educational evaluation. 

5. Attitudinal Climate. Ti e program should be concerned with 
the preparation of people to appreciate the need for more 
effective educational evaluation, thus become more receptive 
to the implementation of evaluation procedures. 

6. Program Clarification. It was suggested that aspects of the 
project and program descriptions contained in Working Paper #10 
lacked clarity and detail. The need for more explicit procedures 
for the accomplishment of the steps outlined in the model was 
pointed out. The need for a less technical description of the 
program activities was suggasted. Also more attention should be 
given to the levels and kinds of data needed by persons in 
various positions within local educational organizations, 
including board members, superintendents, principals, and 
teachers for effective evaluation. 
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7, Program Objectives . It was suggested that the program doei 
not give adequate attention to undeveloped or non-existent 
tools / methods y and strategies in which evaluators need to 
be skilled and competent to be effective; and t* at the 
Evaluator Development Program include as one of its specific 
objectives evidence of concern for the development of these 
new tools, methods, and strategies. 

Section B: Tabulation of Responses to Task Ite ms or the C onsultant Form. 

Table 1 summarizes the consultant responses as follows: 

(1) Column 1 reports the task number. 

(2) Column 2 reports the task statement. 

(3) Column 3 reports the frequency of selection of the 
task as one of the five (5) tasks that should be 
given highest development priority in this program. 

(4) Column 4 reports the respondents perceptions of the 
importance of the task as extremely, moderate, 
slightly, not important. 

(5) Column 5 reports the potential for development as 
perceived by the respondents. 

(6) Column 6 reports the likelihood of the ta c k being 
executed in a school setting as perceived by the 
respondents . 
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The tasks are arrange'] according to the frequence y with which 
they are selected as one of the five most important tasks that 
should be given priority. Those tasks which were not selected as 
one of the five most important are ordered according to the frequency 
by which the respondents reported the task to be extremely important 
to the evaluation process. 
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TAELE 1: Consultant Responses to Each of Forty-Four Tasks 
in Terms of Development Priority, Importance to the Evaluation Process, 
Potential for Development, and Likelihood of Implementation. 
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PART III: STAFF RECOMMENDATIONS FOR FUTURE PROGRAM DEVELOPMENT 



It is recommended that the Evaluator Development Program be discon- 
tinued as a CERLI activity unless significant program interest is demonstrated 
by the CERLV staff and Board ot Control as evidenced by the allocation of 
personnel and resources similar in amoun; to that outlined in Section A, 

Basic Program, below. 



Activity 



Means to Accomplish 



Cost (Dec. 1 - 
Nov. 30, 1968) 



A. Basic Program 



1. Incorporate the 
suggestions of 
the consultants 
into the program 
(Fall 1967). 



1-1 Hire a program coordinator, a $54,500 
program officer, and a research 
assistant and a secretary. 



1-2 Establish a program advisory 
committee to provide direction, 
and assist in formulating more 
comprehensive conceptual frame- 
work. (Suggest old staff along 
with outside consultants that 
have participated in program devel- 
opment to date) . 



10 for 10 days 
@ $100 including 
expenses . 
$10,000 



2 . Select tasks for 
development as 
outlined in the 
model. (Fall 1967 
thru spring 1968). 



2-1 Developed by staff and CERLI 
contracts with other consultants 
or agencies to develop selected 
tasks . 



30 tasks @ 

$2 , 000 each - 
$60,000. 



3. Evaluators trained. 
(Summer 1968) . 



3-1 CERLI trains , or 

3-2 CERLI contracts for 
training activities, or 

3-3 CERLI arranges for 
training. 



Participating 
agencies provide 
own stipends 
and participants 
costs . 



O 

ERIC 



18 



18. 



4. Trained evalu- 4-1 CERLI staff function, 

ators* studied in 

institutional 
settings (Fall 
1968). 

5. Program is modi- 5-1 CERLI staff, 

fled in lieu of 

input gained from 
activities to date. 

(Winter 1969) . 



(Travel, space, 
and other admin- 
istrative expenses) 
- $ 20 , 000 . 



Estimated Basic Program Costs (Dec. 1, 1967-Nov. 30, 1968) $144,500. 



B. Basic Program Expanded: OPTIONAL 

Exploratory Extension of Evaluator Development Program Focused 
Upon Two-Year Institutions of Higher Education. 

1. Initiate exploratory program discussed in attached July 18 

Idea Consideration Draft for Board of Control of CERLI entitled: 
A Special Development in t he Evaluator Development Program 
Focused Upon the Two-Year Institutions of Higher Education. 



Staff member and secretary 

Consultants 

Travel and per diem 

Space and other administrative 
support 



$24,500. 

2,500. 

6 , 000 . 

3,000. 



$36,000. 



(Total cost if (B) Exploratory Extension of Evaluator Development Program 
is implemented concurrently with (Aj Basic Program - approximately 
$180,500). 



♦Recommend that consideration be given to the possibility of funding the 
establishment of evaluator-like positions in institutions through a 
CERLI-developed Title III project. 



INITIAL CONTACT FORM 



Initial contact with 



Consultant 



Phone 



Date 



Caller 



I . INTRODUCTION OF SELF AND POSITION 



A, Name 

B, Organization - CERLI 

C, Location - 111 N. Capitol, Indianapolis, Indiana 46204 
II. PROGRAM IDENTIFICATION AND BACKGROUND 



A. Evaluator Role Development Program 

1. Original assignment - the evaluator as a middleman role. 

2. We have focused upon: 

a. Task identification and development. We have conceived 

of this process in these stages of development. 

1. A list c£ 45 evaluative things or tasks lo be done 
in evaluative processes was evolved. 

2. Task description in terms of critical concepts and 
elements with main acts to be performed and outcomes. 

We have completed this stage of development (go through 
detail on a task) . 

3. Explication of skills and competencies necessary to 
perform given task9, 

4. Design of curriculum to effect the performance of 
given tasks » 

5. Trial application of the curriculum. 
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b. Position identification and development. 

1. Presently is undeveloped but is viewed as 

clustering of tasks into job descriptions for 
institutional positions. 

c. Would like to engage you as a consultant 
III. YOUR ROLE AS CONSULTANT WOULD BE 

A. To review the progress of the program to date which we have 
summarized in a working paper that we would like to forward 

to you. We would ask for your evaluative remarks, suggestions, 
reactions, and recommendations in regard to the program. The 
draft which we sent to the printer was about 100 pages double 
spaced. We estimate that it would take 2-4 hours of your time. 
Specifically we would like your reactions to the described tasks 
as to; 

1. The importance of the tasks to the process of evaluation. 

2. The potential for development of the task. 

3. The likelihooa o f the task being carried out in school 
settings . 

B. If you are interested we will send you a copy of the working 
paper and a letter summarizing these comments, and a response 
form. This would be followed by another phone conversation and/or 
interview to clarify questions and comments regarding the prcject. 

IV. PETAILS 

A. Remuner ' ' ion : $25.00 - in view of our limited budget. 

B. Are you interested? 

1. If yes, what is your availability in July? Would you prefer 
follow-up by phone, letter, interview? 

C. Our address and phone. 

D. Your address. 

THANK YOU 
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COVER LETTER 



Dear (Co n sultant; : 

This letter is to confirm our telephone conversation of June _ 
with reference to your role as a special consultant to the Evaluator 
Development Program of the Cooperative Educational Research Laboratory, 
Inc. This Program, conceived with the hope that it might be appropriate 
for what researchers call the area of educational middleman development, 
incorporates three phases - task, position, and role development. 

Since the inception of the Program in February 1967, virtually aLJ 
of the effort of CERLI f s staff in Indianapolis has been applied to tne 
Task Development Project of the Program. Early stages of the Program 
model appropriate for purposes of describing highlights of the Task 
Development Project include: 

1. Task listings; (see pages 24-27) 

2. Task descriptions constituting definition of critical 
concepts and elements, main acts to be performed, and 
intended outcomes; (see pages 28-95) 

3. Explication of skills and competencies necessary for 
performance of given tasks; 

4. Design of curriculum to effect the performance of 
given tasks; and 

5. Trial application of the curriculum. 

The working paper enclosed herein chronicles the progress of the 
Program, and especially the Task Development Project to date, and in- 
eludes the contents of items number 1 and 2 above. 

The Position Development Project, while discussed briefly on page 
15 of the working paper, presently has received only peripheral develop- 
ment attention, but is seen primarily as a series of processes for the 
purpose of clustering tasks into job descriptions for institutional 
positions. The Role Development Project i 3 yet to be identified. 
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Cover letter (continued) 



The CERLI staff is asking you to review the progress of the 
Program to date and to off>:r evaluative remarks, suggestions, reactions, 
and recommendations . Accompanying tais letter is a consultant form 
that conveys to you the nature of the information sought by the staff 
from your responses. While the response pages appear lengtny, your 
responses can be made very readily. Two copies of the consultant form 
are included, one for your files and one to be returned to the Program 
staff in the enclosed envelope, For your services, CERLl’s limited 
budget permits an offer of $^5.00 as remuneration* 

Our telephone conversation indicated that you prefer to have CERLI 's 
follow-up contact with you arranged - (by phone, by visit, by return mail) 

on the following days in July: , appointed hour, location, etc. 

In order to expedite such arrangements, I shall again be telephoning you 
very soon. 

Again, thank you for your interest in assisting the Evaluator 
Development Program staff to carry out its own current series of 
essential evaluative activities. 



Sincerely , 



CONSULTANT REPORT 



NAME OF CONSULTANT 
ADDRES S 



DIRECTIONS I 

In Part A you are asked to respond to each of the tasks in terms 
of your perceptions of: 

1. The importance of the tasks to the evaluation process. 

2. The potential for development of the task. 

3. The likelihood of the task being carried out in school 
settings . 

In Part B you will be asked to select five (5) tasks that are 
In most need of development as defined in this program; in Part C to 
list evaluative tasks that are not listed herein; and in Part D to 
summarize other remarks, suggestions, reactions, and re commend a tioi. 
which you have relating to the project or program. 
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PART A : Place a check in the blank space after the response which best 

summarizes your judgment s^hout each question. 



TASK 1 - To identify the broad purposes of the institution. 

1. How important is this task in the evaluation process? 

Extremely * Moderately , Slightly , Not ^ 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes_ No 



TASK 2 - To identify and select criteria upon which judgments 
about institutional objectives may be made. 

1. How important; Is this task ^n the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 3 - To identify procedures and processes for the evaluation 
ol* professional personnel of the institution. 

1. How important i3 this tas!. in the evaluation process? 

Extremely , Moderately Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

T. If developed, is it likely that this task would be executed 
In school settings? 

Yes No 
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TASK 4 - To identify the outcomes which are contingent upon 
particular antecedent conditions or strategies. 

1. How important is this task in the e ,r alua^ion process? 

Extremely , Moderately , Slightly , Not 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 5 - To identify the consequent side effects of the strategies 
or practices in a program implementation. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not_ . 

2. Can this task he developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 6 - To develop valid and reliable measurement instruments 
and techniques. 

1. How important is this task in tb' valuation process? 

Extremely , Moderately ilight.ly , Not . 

2i Can this task be developed as .lined sequentially in the 
program model appearing on paf J 9-10? 

Yes No 

3. If developed, is it likely that this task wiuld be executed 
in school settings? 

Yes No 
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TASK 7 - To design procedures and processes for the evaluation of 
professional personnel of the institution. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 8 - To c* 2 sign field testing procedures. 

1. How important is this task in the evaluation process? 

Extremel y , Moderately , Slightl y Not . 

2. Can this task be developed as outlines sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 9 * To prepare project ot program proposals. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can tain task be developed as outlined sequentially in the 
program model appearing on pages C-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 
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TASK 10 - To design studies for given institutional purposes. 

1* How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9*10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 11 - To assist curriculum specialists, supervisors and teachers 
in the development of materials and practices that can be 
evaluated in terms of specific objectives. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is It likely that this task would be executed 
in school settings? 

Yes No 



TASK 12 - To develop descriptive information about programs. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 
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TASK 13 - To develop generalizations about the program and its 
practices . 

1* How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not , 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 14 - To develop practitioner readiness for evaluation* 

1. Ho;* important is this task in the evaluation process? 

Extremely , Moderately , Slightly Not . 

2. C*n this task be developed ae outlined sequentially In the 
program model appearing on pages 9-10? 

Yes Vo 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 15 - To judge the relative merits of each of the broad 
purposes of the institution. 

1. Hew important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes_ No 

3. If developed, is it likely that this task vould be executed 
in school settings? 

Y e s No 
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TASK 16 - To assess the consequences of educational practices 

1* How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 17 - To assess the consequences of educacional programs. 

1* How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this ta3k would be executed 
in school settings? 

Yes __ No 



TASK 18 - To evaluate programs or practices developed, tested or 
adopted in other settings. 

1. How Important Is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task l j developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, Is It likely that this task would be executed 
in school settings? 

Yes No 
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TASK 19 - To make judgments about programs or practices developed, 
tested or adopted in other settings. 

1. How important is this task in the evaluation process'/ 

Extremel y , Moderately , Slightly__ , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developedj is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 20 - To assess the congruence between what the program does 
and intend^ to do. 

1. Kow important d^s this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program mode}, appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 21 - To translate the broad purposes of the institution into 
forms suitable for treatment and application* 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Nr>t . 

2. Can this task te developed as outlined sequentially in fhe 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 
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TASK 22 - To report the results of the evaluations of programs 
and practices in terms of given criteria. 

1. How important is this task in the evaluation process? 

Extremely , Moderately > Slightly , Not . 

2. Can this task be developed as outlined sequentially in thp 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 23 - To interpret the results of the evaluations of programs 
and practices in terms of given criteria. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not _. 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
In school settings? 

Yes No 



TASK 24 - To aid in the interpretation of the results of the 
evaluation of programs and practices. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing or: pages 9-10? 

Yes_ No 

3* If developed, is it likely that this task would be execut .d 
in school settings? 

Yes No 




32 



9. 



TASK 25 - To encourage the adoption of innovative programs and 
practices, 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3* If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 26 - To interpret for the public(s) the results of th^ 

evaluation of programs and practices as they relate 
<o objectives and outcomes. 

1. How important is t:his task in the evaluation process? 

Extremely , Moderately , Slightly^ , Not . 

2. Can this task be developed as outlined sequentially in t : 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



YaSK 27 - To explicate the rationale for developmental programs. 

1. How Important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 
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TASK 28 - To translate program objectives into behavioral 
or operational terms. 

1. How important is this task in the evaluation process? 

Extremely f Moderately t Slightly , Not , . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed! Is it likely that this task would be executed 
In school settings? 

Yes No 



TASK 29 - To feedback the data relating to the congruence of the 
outcomes and intents resulting from the program, 

1. How important is this task in the evaluation procesr? 

Extremely Moderately , Slightl y t Not ( . 

2* Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task wou be executed 
in school settings? 

Yea No 



T/.SK 30 - To present generalizations and data to the decision- 
makers in a form that will enable them to identify gal 
and losses from a particular program. 

1. How Important is this task in the eva* nation process? 

Extremely , Moderately Slightly > Not , 

2. Can this task be developed as outlinM sequentially in V e 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be execu* 
in school settings? 

Yes No_ ‘ 



o 
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TASK 31 - To determine the nature of the decision-making process 
in the institution. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 32 - To apply valid and reliable measurement instruments and 
techniques , 

1. How important is this task in the evaluation process? 

Extremely , Moderately (> Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 33 - To direct field testing procedures. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yea No 



o 
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TASK 34 - To analyze the findings of the evaluations of programs 
and practices in terms of given criteria. 

1. How important is this task in the evaluation process? 

Extremely , Moderately Slightly , No t 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 

3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 35 - To accumulate project or program information about 
similar programs in other settings. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likrly that this task wpuld be executed 
in school settings? 

Yes No 



TASK 36 - To implement and maintain a data bank. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , No t 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 
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TASK 37 - To implement and maintain a feedback system for a data 
bank. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed ao outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 38 “ To implement procedures and processes for the evaluation 
of professional personnel of the institution. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not , 

2 , Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3, If developed, is it likely that this task would be executed 
in school settings? 

Yes__ No 



TASK 39 - To advise users in the selection, construction and use 
of measurement instruments. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Y e s No 



3 . If developed, is it likely that this task would be executed 
in school settings? 

Yes No 




37 



14. 



TASK 40 - To provide counsel with teachers about the problems and 
procedures of individual pupil evaluation. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 41 - To provide counsel for educational practitioners in the 
process of self-evaluation. 

1. How important is this task in the evaluation process? 

Extremely , Moderately . Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3- If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 42 - To provide measurement and evaluation services. 

1. How important is this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

2. Can this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



o 
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TASK 43 - To aid in the process of training users in the utilization 
of the results of evaluation. 

1. How important i.s this task in the evaluation process? 

Extremely , Moderately , Slightly , Not . 

' % l 

2. Can this task be developed at' outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



TASK 44 - To assist curriculum specialists, supervisors, and 
teachers in the adoption of materials and practices 
that can be evaluated in terms of specific objectives. 

1. How important is this task in the evaluation process? 

Extremely^ Moderately , Slightly , Not , 

2. CAn this task be developed as outlined sequentially in the 
program model appearing on pages 9-10? 

Yes No 



3. If developed, is it likely that this task would be executed 
in school settings? 

Yes No 



PART B: Select the five (5) evaluative tasks from the forty-four that you 

believe should be given highest development priority in this program. 

TASK No. 



1 . 



2 . 



3. 



4. 



5 . 



o 
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PART C: List any Important evaluative tasks that you perceive to be 

missing from the above task list. 



PART D: Please summarize any additional evaluative remarks, suggestions, 

reactions, and recommendations relating to the Evaluator Development 
Program, the Evaluator Task Development Project, the steps involved 
in the Project and other aspects relating to the Project or Program. 
(Please use back of page or additional pages i* needed.) 
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